Increasing Diversity in Random Forests Using Naive Bayes
نویسندگان
چکیده
In this work a novel ensemble technique for generating random decision forests is presented. The proposed technique incorporates a Naive Bayes classification model to increase the diversity of the trees in the forest in order to improve the performance in terms of classification accuracy. Experimental results on several benchmark data sets show that the proposed method archives outstanding predictive performance compared to other state-of-the-art ensemble methods.
منابع مشابه
Prediction and Classification of Cardiac Arrhythmia
Cardiac Arrhythmia refers to a medical condition in which heart beats irregularly. This paper aims to detect and classify arrhythmia into 14 different variants. A few popular techniques from contemporary literature were implemented namely Naive Bayes, feature selection, SVM, Random Forests and Neural Networks.A new approach combining SVM and Random Forests classifiers was also implemented.
متن کاملDiagnosis of Pulmonary Tuberculosis Using Artificial Intelligence (Naive Bayes Algorithm)
Background and Aim: Despite the implementation of effective preventive and therapeutic programs, no significant success has been achieved in the reduction of tuberculosis. One of the reasons is the delay in diagnosis. Therefore, the creation of a diagnostic aid system can help to diagnose early Tuberculosis. The purpose of this research was to evaluate the role of the Naive Bayes algorithm as a...
متن کاملAn Empirical Comparison of Supervised Learning Algorithms Using Different Performance Metrics
We present results from a large-scale empirical comparison between ten learning methods: SVMs, neural nets, logistic regression, naive bayes, memory-based learning, random forests, decision trees, bagged trees, boosted trees, and boosted stumps. We evaluate the methods on binary classification problems using nine performance criteria: accuracy, squared error, cross-entropy, ROC Area, F-score, p...
متن کاملRandom Multiclass Classification: Generalizing Random Forests to Random MNL and Random NB
Random Forests (RF) is a successful classifier exhibiting performance comparable to Adaboost, but is more robust. The exploitation of two sources of randomness, random inputs (bagging) and random features, make RF accurate classifiers in several domains. We hypothesize that methods other than classification or regression trees could also benefit from injecting randomness. This paper generalizes...
متن کاملEnergy Efficiency Data Mining for Wireless Sensor Networks Based on Random Forests
In this paper, we propose a novel data mining technique involving random forests and random trees for energy efficiency for forest cover type classification. Novel machine learning and data mining techniques provide an unprecedented opportunity to monitor and characterize physical environments, such as forest cover type, using low cost wireless sensor networks. However, given the sheer amount o...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2016